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COMMUNICATION APPARATUS 

Background of Invention 

[0001] Field of the Invention 

[0002] The present invention relates to an input apparatus or a communication terminal 
used for character entry. 

[0003] Background Art 

[0004] With the wide spreading use of portable telephones and other mobile terminals, 
such terminals are very actively employed for exchanging messages. And as is well 
known, senders use terminal input keys when entering character strings for messages. 
For this purpose, various input methods are presently provided. According to one 
example method, numeric keys 0 to 9, an asterisk key "*" and a pound key "#" are 
employed when entering or deleting kana Uapanese characters) or alphabet 
characters, as well as when entering other data. Fig. 14 is a diagram showing example 
characters and operations assigned by this method to the keys of a portable 
telephone terminal. For example, to input the kana character "ko", numeric key "2" is 
depressed five times and the pound key is depressed to verify the entry. While for the 
character "M", numeric key "6" is depressed 1 6 times, followed by the pound key. 

[0005] Another character string input method is the technique, disclosed, for example, in 
Japanese Published Unexamined Patent Application (PUPA) No. Hei 6-6454, that is 
used as an input method for a pager, such as a so-called pocket bell (hereinafter 
referred to as a pager method). As is shown in Fig. 1 5, according to this technique a 
two-digit number is input to enter a character. For these numbers, the first digit (the 
tens digit) represents a consonant "row", and the second digit (the units digit) 
represents a vowel "column". For example, since the kana character "ko" is in the "k" 
row and the "o" column, its number is "25", and to enter it, only key "2" and then key 
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"5" are depressed. Therefore, two numbers consists one character. 

[0006] However, with the conventional portable telephone terminal input method 
described above, the key "6" must be depressed 1 6 times to enter the alphabet 
character "M M , and a great deal of time and effort are required. 

[0007] According to the pager method disclosed in Japanese Published Unexamined 

Patent Application (PUPA) No. Hei 6-6454, only two key depressions are required to 
enter a character, which is certainly an advantage. Furthermore, the regularity with 
which numbers are assigned for kana characters "a" to "wo" makes it easy to 
remember them. However, since that regularity does not apply to the kana character 
"n", consonants and alphabet characters, the user must remember the numbers for 
these characters. Further, neither the portable telephone terminal method nor the 
pager method are very useful because each terminal maker arranges the input keys 
differently. In addition, although entering characters using a portable telephone 
terminal is frequently a one-handed-one-thumb operation, this can not be considered 
a superior process. 

[0008] Furthermore, substantially, the conventional input method does not take usage by 
visually impaired persons into account. For while not merely a problem of the visually 
impaired, input errors tend to occur because so many movements of the thumb are 
required to manipulate the twelve input keys, "0" to "9", "*" and "#". Of course, since 
an input character appears on the display of a portable telephone terminal, an 
ordinary user can readily ascertain an entry error has been made, but no such means 
is available to assist a visually impaired person. 

[0009] Recently, not only with personal computers but also with portable telephone 
terminals or other mobile terminals, it has become possible to use the Internet to 
obtain various services. But to avail one's self of a service, one must use a portable 
telephone terminal to access, through the Internet, the server that provides it, and 
must manipulate the portable telephone terminal in accordance with instructions that 
are received and displayed on a menu screen. However, since visually impaired 
persons can not see instructions received from servers when they are displayed on 
menu screens, they are effectively prevented from obtaining any services. 
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[0010] 



It is, therefore, one object of the present invention to provide an input apparatus, 
a communication terminal and a portable communication terminal that are eminently 
usable, especially by visually impaired persons when entering characters. 



[0011] 



It is another object of the present invention to provide a speech feedback system, 
a speech feedback server and a communication terminal that can provide various 
services for visually impaired persons. 



Summary of Invention 



[0012] 



To achieve the above objects, according to an input apparatus for the present 



invention, keys for the two columns and three rows of dots used for Braille are 
allocated for multiple input key means. Manipulated keys are identified by key 
identification means, and based on the location of the identified keys, a 
corresponding Braille dot combination is specified by Braille specification means. 
Thereafter, character conversion means converts the Braille dot combination into a 
character, and the data for that character are output by character data output means. 
Thus, a user can input a character by employing the two columns and three rows of 
dots used for Braille. 

[001 3] Another feature of the present invention includes a communication terminal 

having a group of keys, arranged in a multiple row, multiple column matrix. Six keys 
are allocated for two columns and three rows of dots used for Braille. Further included 
is a processor, for specifying a Braille dot combination corresponding to manipulated 
keys, for converting the specified Braille dot combination into a character, and for 
outputting that character via a communication unit. 

[0014] Still another feature of the present invention can be regarded as a portable 

communication terminal having a key body and a display body that can be folded 
together so that the surface of the key body on which operating keys are positioned 
and the surface of the display body on which a display panel is positioned are 
exposed. 

[001 5] According to yet another feature of the present invention a speech feedback 
system used in accordance with an operation user terminal, transmits a signal in 
accordance with the manipulation of operating keys. A server at a service provider 
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converts the received signal into a character, and based on the character, generates a 
speech synthesis signal that it transmits as a feedback signal. Thereafter, the user 
terminal outputs speech based on the received feedback signal. 

[001 6] Various other objects, features, and attendant advantages of the present invention 
will become more fully appreciated as the same becomes better understood when 
considered in conjunction with the accompanying drawings, in which like reference 
characters designate the same or similar parts throughout the several views. 

Brief Description of Drawings 

[001 7] Fig. 1 is a diagram showing the configuration of a terminal according to a first 
embodiment. 

[0018] Fig. 2 is a diagram showing an example terminal. 

[001 9] Fig. 3 is a diagram showing another example terminal. 

[0020] Fig. 4A is a diagram showing an additional example terminal that is open. 

[0021] Fig. 4B is a diagram showing an additional example terminal that has been folded. 

[0022] Fig. 5A is a diagram showing a correlation between input terminal keys and for 
dots forming Braille dot combinations. 

[0023] Figs. 5B and 5C are diagrams showing specific input examples. 

[0024] Fig. 6 is a diagram showing one part of a Braille list in Japanese. 

[0025] Fig. 7 is a diagram showing the list for the Braille input method in this 
embodiment. 

[0026] Fig. 8 is a succeeding diagram for Fig. 7. 

[0027] Fig. 9 is a flowchart showing the processing performed for inputting Braille. 

[0028] Fig. 1 0 is a diagram showing a system configuration according to a second 
embodiment. 

[0029] 

Fig. 1 1 is a diagram showing the configuration of a terminal according to the 
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second embodiment. 

[0030] Fig. 1 2 is a diagram showing the arrangement of a server. 

[0031] Fig. 13 is a flowchart showing the processing performed by the server. 

[0032] Fig. 14 is a diagram showing an example conventional character input method. 

[0033] Fig. 1 5 is a diagram showing another example conventional character input 
method. 

Detailed Description 

[0034] The output character data destination may be either inside or outside the input 

— apparatus. If the destination is inside, the character data may be used to form a 

p character string that is stored in the memory of the input apparatus, and in addition, 

*'y based on the data, the character may be displayed or printed. If, however, the output 

S O character data destination is outside the input apparatus, the character data may be 

\. J! 

m transmitted to another terminal or server as a message to a correspondent. 

N [0035] When, based on character data, speech synthesis means generates speech 

P 

I j synthesis data, and based on that data speech output means releases speech, a user 

can receive speech as feedback. 

i 

[0036] An arbitrary input apparatus can be employed so long as characters are input in 
Braille. Thus, a portable telephone terminal or various other information terminals 
may be employed. 

[0037] 

For of group of keys arranged as a matrix, since the arrangement of the keys 
matches the arrangement of the dots used for Braille, so long as a person understands 
Braille, he or she can easily achieve proficiency in the use of keys that are arranged 
horizontally or obliquely. A first key mode, for allocating ordinary numbers, such as 0 
to 9, or symbols, such as * and #, and a second key mode, for allocating dots used for 
Braille, may be switched between, and a third key mode, for allocating characters, may 
also be added and switched to. Therefore, when the numeric keys used for entering 
telephone numbers (numbers) are the keys regularly employed for the telephone 
terminal, the Braille input mode and the character input mode can also be provided, 
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while the additional character input mode can be, for example, either the 
contemporary portable telephone terminal method or the pager method. One or more 
of these modes may be included. In the second mode, Braille viewed from the Braille 
reading face and Braille viewed from the Braille writing face may be selectable when 
allocating Braille dot combinations to the keys. 

[0038] When a tone generator, for generating different tones for each column and row of 
the keys, has a so-called DTMF (Dual Tone Multiple Frequency) function, and when n 
keys have been manipulated and tones corresponding to two columns and n rows are 
detected, it may be assumed that keys have been manipulated that are located where 
the two columns and n rows intersect. This arrangement is especially effective when a 
p server receives and processes tones. 

a 

[0039] The dots used for Braille are allocated for keys arranged in two columns and three 

| : y rows, and n is either two or three. When two keys are manipulated and tones 

m 

^ corresponding to two columns and two rows are detected, it is assumed that four keys 

P located at positions whereat two columns and two rows intersect have been 

| J& manipulated, and when three keys are manipulated and tones corresponding to two 

J :s J columns and three rows are detected, it is assumed that six keys located where two 

3. La 

H columns and three rows intersect have been manipulated. As a result, key 

3 " manipulation can be eliminated for a communication terminal that permits the 

E 

depression of only one key each time. When the same key is depressed multiple times 
in the second mode, these depressions may be regarded as a single depression. And 
since Braille is not affected when the same key is manipulated at multiple times for 
one character, the erroneous operation can be allowed. 

[0040] 

Thus, when a portable communication terminal is held so that the display panel 
side faces the user and the operating key side, the reverse, faces away from the user, 
the user can easily manipulate the operating keys by using one finger of the hand 
grasping the terminal. With the portable communication terminal, when the dots for 
Braille are allocated for six operating keys arranged as two columns and three rows, 
Braille dot combinations can be input. Furthermore, speech feedback corresponding 
to the input characters can also be provided. When the dots for Braille are allocated to 
a column near one end of the key body and to another column near the other end, a 
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user can easily use both hands to hold the portable communication terminal and 
manipulate the keys. 

[0041] When a character is entered at a user terminal, corresponding speech is fed back 
by the server at the service provider. In this case, at the user terminal only the 
operating keys are manipulated, while the character conversion and the generation of 
the speech synthesis signal are performed by the server at the service provider. Thus, 
since the user terminal must perform no new function, a conventional terminal can be 
employed. 

[0042] Also, at the user terminal the operating keys may merely be regarded as dots used 
for entering Braille. In this case, in accordance with the manipulation of the operating 
keys, the character converter specifies a Braille dot combination that it converts into a 
character. Further, the server at the service provider may output, as a speech signal, a 
message requesting input by the user terminal. Thus, the message may be output 
orally by the user terminal, thereby increasing the usability for a visually impaired 
person. 

[0043] Furthermore, the server at the service provider and the speech feedback server 
can, by sequentially accumulating characters obtained by conversion, generate a 
character string a user has employed to submit a request, and perform a process in 
response to the request. 

[0044] In this case, the user terminal transmits, to an external host server, a signal or 

signals consonant with the manipulation of the keys. The host server, in turn, converts 
the signal or signals into Braille, and generates a speech response signal 
corresponding to a character or characters obtained by converting the Braille. The 
user terminal may thereafter receive the speech response signal and output speech 
based on the signal. At this time, however, the speech response signal may not merely 
be the reading of the character or the string of characters obtained by converting the 
Braille, but may instead be a response engendered by the content of the character 
string. More specifically, when "search" is entered by the terminal, either "search" is 
read orally, or a response such as "What do you want to search?" is issued. 

[0045] 

The preferred embodiments of the present invention will now be described in 
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detail while referring to the accompanying drawings. 



[0046] 



Fig. 1 is a diagram for explaining the basic configuration of a communication 



terminal (hereinafter referred to simply as a "terminal") according to a first 
embodiment of the invention. As is shown in Fig. 1, a terminal 10, which serves as an 
input apparatus and a communication terminal, includes: multiple input keys (input 
means, a key group and an operating key) 1 1 , such as numerical keys and other 
symbol keys; a display unit 12, for displaying information such as characters entered 
using the input keys 1 1 ; a loudspeaker (speech output means) 1 3, for releasing 
speech; and a controller (processor) 14, for providing overall control of the operation. 

[0047] The controller 14 includes a key recognition unit (key identification means and a 
key detector) 1 5, a character converter (Braille specification means, character 
conversion means and character data output means) 16, a character string data 
storage unit 1 7, a speech synthesis controller (speech synthesis means) 1 8 and a 
communication unit 1 9, and performs a process based on a control program stored in 
the memory area (not shown) of the controller 1 4. 

[0048] Upon the manipulation of the input keys 1 1 , the key recognition unit 1 5 identifies 
the input keys 1 1 and transfers a corresponding entry to the character converter 1 6. 
Upon the receipt of the entry, the character converter 1 6 converts it into a character 
correlated in advance. This character conversion is performed for each character, and 
the obtained character data are transmitted (output) to the character string data 
storage unit 1 7. In addition, although not always required, the character data obtained 
by the character converter 1 6 may be output to the display unit 1 2 for display 
thereon. 

[0049] The character string data storage unit 1 7 is used to sequentially store the 

character data as they are received from the character converter 1 6, and based on this 
character data, generates a character string. Then, when a predetermined command is 
input, the character string data storage unit 1 7 transmits the data for the generated 
character string to the speech synthesis controller 1 8. 



The speech synthesis controller 18 employs a speech synthesis program, stored in 
advance in the memory area of the controller 14, to perform a speech synthesis 



[0050] 
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process and generate speech data based on the received character string data. Then, 
synthesized speech based on the speech data is output through the loudspeaker 1 3. 
The communication unit 1 9 is used to communicate with an external device using a 
public telephone network or the Internet, or some other network. 

[0051 ] Figs. 2 to 4 are diagrams showing specific examples for the terminal 1 0. A 

terminal 10A in Fig. 2 is a so-called stationary telephone set, and its main body 21 
includes, as input keys 1 1 , numerical keys 1 1 N for entering the numbers 0 to 9, an 
asterisk key 1 1 A for entering the symbol and a pound sign key 1 IS for entering 
the symbol "#". In addition, a display unit 12 is provided for the main body 21 of the 
terminal 1 OA, and a loudspeaker 1 3 is provided for a handset 22. 



[0052] A terminal 1 0B in Fig. 3 is a portable telephone terminal, such as a portable 

^ telephone or a PHS (Personal Handy-phone System), and its main body 31 includes, as 

ry the input keys 1 1 , numerical keys 1 1 N, an asterisk key 1 1 A, a pound sign key 1 1 S, a 

; : ^ display unit 1 2 and a loudspeaker 1 3. An arbitrary terminal 1 0B can be employed so 

|;R long as the main body 31 includes the numerical keys 1 1 N, the asterisk key 1 1 A, the 

i tS> pound sign key 1 1 S and the loudspeaker 1 3. Thus, for example, a cordless telephone 

a -3 can fall in the terminal 1 0B category. In this case, the display unit 1 2 is not a requisite 

y 

□ component. 

[0053] A terminal 1 0C in Figs. 4A and 4B is a folding type telephone terminal, for which a 
monitor body (display body) 41 and a key body 42 are coupled pivotally at hinges 43. 
The monitor body 41 includes a display unit 1 2 and a loudspeaker 1 3, and the key 
body 42 includes, as the input keys 1 1 , numerical keys 1 1 N, an asterisk key 1 1 A and 
a pound sign key 1 1 S. As is indicated by an arrow in Fig. 4A, The terminal 1 0C can be 
folded at the hinges 43, so that the face of the monitor body 41 , wherein the display 
unit 1 2 is provided, and the face of the key body 42, whereon the input keys 1 1 are 
provided, are exposed. 

[0054] The terminal 10C in the folded state is shown in Fig. 4B. In this state, a user can 
use both hands to hold the terminal 1 0C with the display unit 1 2 facing up (this side 
is regarded as the obverse), and can use the fingers of both hands to manipulate the 
input keys located on the reverse. 



APP ID=09682896 



Page 9 of 49 



[0055] The terminal 1 0, which can be represented by the terminals 1 OA, 1 OB and 1 OC, 
permits the input, using the input keys 1 1 , not only of numbers in the original 
number input mode (first mode), but also of characters either in the so-called 
portable telephone terminal character input mode (the third mode) or in the pager 
character input mode (the third mode), or in the Braille character input mode (the 
second mode). These modes can be either user or automatically selected. 

[0056] Braille character input will now be explained. For Braille, an entry is represented by 
a six-dot, two column and three row combination. For character input, of the input 
keys 1 1 the terminal 1 0 permits two columns of three keys each to be used for the 
entry of a Braille dot combination, and converts the entry into a character. For the 
p terminals 10A in Fig. 2, for example, of the numerical keys 1 IN, keys "1", "2", "4", "5", 

jlfj "7" and "8" (the block enclosed by broken line a in Fig. 2) are employed. Of course, the 

CS keys "2", "3", "5", "6", "8" and "9" may also be employed. 

§ Li! 

' g [0057] For the terminals 1 OB and 1 OC in Figs. 3 and 4, the numerical keys 1 1 N in the 

W columns to either side of the terminals, e.g., keys "1 "3", "4", "6", "7" and "9" (the 

blocks enclosed by broken lines b in Figs. 3 and 4), are employed. Thus, a user can 
^ use both hands to manipulate the numerical keys 11 N of the terminals 1 OB and 1 OC. 

p [0058] An example Braille entry using the terminal 1 0 (1 OA, 1 OB or 1 Oc) is given below. 

v " For this example, the numerical keys 1 1 N of the terminal 1 OA in Fig. 2 are used. As is 

shown in Fig. 5A, for the entry of Braille, certain of the numerical keys 1 1 N, arranged 
in two columns and three rows, are allocated for dots PI to P6. More specifically, of 
the numerical keys 1 1 N, "1" is allocated for the top left top dot PI , "2" is allocated for 
the top right top dot P2, "4" is allocated for the middle left dot P3, "5" is allocated for 
the middle right dot P4, "7" is allocated for the bottom left dot P5, and "8" is allocated 
for the bottom right dot P6. In addition, the pound sign key 1 IS is allocated as an 
entry confirmation key. Of the numerical keys 1 1 N, a terminal 1 OA user manipulates 
keys "l ", "2", "4", "5", "7" and "8" for a Braille entry, and confirms the entry using the 
pound sign key (sharp mark key) IIS. Then, after the pound sign key 1 IS has been 
entered, the key recognition unit 1 5 in Fig. 1 identifies the numerical keys 1 1 N that 
were manipulated, and the character converter 1 6 employs those numerical keys 1 1 N 
to specify the Braille dot combination that was input. 
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[0059] One part of the correlation of the Braille dot combinations and characters is shown 
in Fig. 6. Other numerical strings entered using keys and corresponding Braille dot 
combinations are shown in Figs. 7 and 8. In Figs. 7 and 8, the column for the "input 
numerical string" represents the types (numbers) of numerical keys 1 1 N that are 
manipulated before an entry is confirmed by the depression of the pound sign key 

I IS. A specific input example using the terminal 10 will now be explained based on 
the correlations shown in Figs. 6, 7 and 8. 

[0060] For example, to input "e" in 1 in Fig. 6, as is shown in Fig. 5B, the numerical keys 

I I N for "1 "2" and "4" are manipulated and the pound sign key 11 S is depressed. 
This establishes the entry of the Braille dot combination corresponding to the dots PI , 
P2 and P3, i.e., the "e" in Braille (Ex. 1 in Fig. 7). 



[0061] To input the Braille for a kana character representing a sonant, such as "ga", as is 

J y shown by 2 in Fig. 6, the numerical key 1 1 N for "5" is depressed, and then the pound 

% X sign key 1 1 S is depressed to shift to the sonant input mode. Following this, the 

P numerical keys 1 1 N for "1 " and "8", which correspond to "ka", are entered, and the 

U entry is confirmed by the depression of the pound sign key 1 IS. As a result, "ga" is 

H input in Braille (Ex. 2 in Fig. 7). 



[0062] Further, to input the Braille for a kana character representing a plosive, such as 
"pa", as is shown by 3 in Fig. 6, the numerical key 1 1 N for "8" is depressed, and then 
the pound sign key 1 1 S is depressed to shift to the plosive input mode. Following this, 
the numerical keys 11 N for "1 ", "7" and "8", which correspond to "ha", are depressed, 
and the entry is confirmed by the depression of the pound sign key 1 1 S (Ex. 3 in Fig. 
8). 

[0063] To input Braille for a foreign (alphabet) character, such as A, as is shown by 4 in 
Fig. 6, the numerical keys 11 N for "5" and "8" are depressed, and then the pound sign 
key 1 IS is depressed to shift to the foreign character input mode. Following this, the 
numerical key 1 1 N for "1 ", which corresponds to "A", is depressed, and the entry is 
confirmed by the depression of the pound sign key 1 IS (Ex. 4 in Fig. 7). 

[0064] 

To input the Braille for a number, such as "1 ", as is shown by 5 in Fig. 6, the 
numerical keys 1 1 N for M 2*\ "5", "7" and "8" are depressed, and the pound sign key 1 1 S 
APPJD-09682896 Page 1 1 of 49 



is depressed for confirmation. As a result, the "Esc (escape)" operation is performed 
and the mode is shifted to the number input mode. Then, the numerical key 1 1 N for 
"1", which corresponds to the number "1", is depressed, and the entry is confirmed by 
the depression of the pound sign key 1 IS (Ex. 5 in Fig. 7). It should be noted that, 
after the Esc operation, the numbers in Braille may be used as well for the input of 
kana character; however, the numbers represented by the numerical keys 1 1 N may be 
directly input before the confirmation using the pound sign key US is performed. 

[0065] For contracted sonants and contracted plosives, the numerical keys 1 1 N for "2" 
and "5" are depressed; for special sounds, the numerical keys 1 1 N for "4" and "8", or 
"4", "5" and "8", or "2" and "8" are depressed; and for contracted sounds, the 
numerical key 1 1 N for "2" is depressed. 

[0066] It should be noted that no restrictions are placed on the depression order used for 
the keys for the above entries. For example, to input kana character "e", the numerical 
keys 1 1 N may be depressed in order from "1 " to "2" to "4", from "1 " to "4" to "2", from 
n 2" to "1 " to "4", from M 2" to "4" to "1 ", from "4" to "1 " to M 2" or from "4" to "2" to "1 ". In 
the "input numerical string" column in Ex. 6 in Fig. 7, "(1 24)!" indicates that an 
arbitrary order can be employed for inputting the numerical string 1 , 2 and 4. To cope 
with this, during a period before the pound sign key 1 IS is depressed for 
confirmation, the character converter 16 employs the manipulations of the numerical 
keys 1 1 N identified by the key recognition unit 1 5 to specify a corresponding Braille 
dot combination. This also applies for all other Braille dot combinations. Further, 
when the same numerical keys 1 IN are depressed multiple times before the pound 
sign key 11 S is depressed, for example, when the numerical keys 1 1 N are depressed 
in the order "1 ", "2", "2" and "4" or "2", "1 ", "2" and "4" to enter "e", the "e" in Braille is 
correctly input because no erroneous identification occurs. 

[0067] 

As is described above, to input a sonant such as "ga" or a plosive such as "pa", the 
numerical key 1 1 N for "5" or "8" is depressed and the pound sign key 1 1 S is 
depressed for confirmation. However, the depression of the pound sign key 1 IS may 
be eliminated. For example, as is shown in Ex. 7 in Fig. 8, to input "za", the numerical 
key 1 1 N for "5" is depressed to shift the mode to the sonant input mode, then, the 
numerical keys 1 1 N for "1 ", "5" and "8", which correspond to "sa", are depressed, and 
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finally, the pound sign key IIS is depressed for confirmation. That is, the numerical 
keys 1 1N for "5", "1", "5" and "8" must be depressed sequentially. Furthermore, to 
input a sonant, the numerical key 1 1 N for "5" is depressed to shift the mode to the 
sonant input mode, or to input a plosive, the numerical key 1 1 N for "8" is depressed 
to shift the mode to the plosive input mode. But when the number string to be 
sequentially input for a character includes "5" or "8", the corresponding numerical key 
may not be depressed. Specifically, to input "da", originally it is necessary to depress 
the numerical key 1 1 N for "5" to shift the mode to the sonant input mode and the 
numerical keys 1 IN for "1", "5" and "7", which correspond to "ta". However, since the 
numerical key 1 1 N for "5" is overlapped, only the numerical key 1 1 N for "5", for 
shifting the mode to the sonant input mode, followed by the numerical keys 1 1 N for 
"1" and "7" must be depressed, while the overlapped "5" is skipped (Ex. 8 in Fig. 7). In 
input number string "(1 57)!-5(l 7)!" shown in Ex. 9 in Fig. 7, "-" represents "removal". 
J'U Since the character "da" is obtained by entering "5(1 7)!" according to the above rule, 

the above number string means that, to input "ta", the number string corresponding 
P to "da" is eliminated by the expression "(1 57)!-5(l 7)!". 

it 

3. X 

^ [0068] When DTMF (Dual Tone Multiple Frequency) is employed for the terminal 10A, key 

i:J manipulation can be eliminated to input, for example, "te" in Braille. As is shown in 

O 

n Fig. 5C and by 6 in Fig. 6, for the Braille entry corresponding to "re", the top dots PI 

3 : 

SiSB and P2 and the middle dots P3 and P4 occupy parallel positions. In this case, originally 

a total of four numerical keys 1 1 N, "1 "2", "4" and 'V, had to be depressed. However, 
in this embodiment, only the numerical keys 1 1 N for "1 " and "5" or for "2" and "4" 
need be depressed. 

[0069] According to DTMF, the frequency of the tone that is generated for each key by a 
tone generator (not shown) is changed upon the manipulation of an input key 1 1, and 
a different frequency is set for a tone that is to be generated for the input key 1 1 of 
each column and each row. For example, in Fig. 5C, a tone having a frequency LI is 
allocated for the column of the numerical keys 1 1 N for "1 "4" and "7", and a tone 
having a frequency L2 is allocated for the column of the numerical keys 1 1 N for "2", 
"5" and "8". Further, a tone having a frequency Dl is allocated for the row of the 
numerical keys 1 1 N for "1 " and "2", a tone having a frequency D2 is allocated for the 
row of the numerical keys 1 1 N for "4" and "5", and a tone having a frequency D3 is 
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allocated for the row of the numerical keys 1 1 N for "7" and "8". Therefore, when each 
of the numerical keys 1 1 N are manipulated, two tones having frequencies 
corresponding to the column and row of the key are generated. Thus, for example, 
when the numerical key 1 1 N for "1" is depressed, the two tones having frequencies LI 
and Dl are generated. And based on the tones that are generated, the key recognition 
unit 15 of the controller 14 can identify the depressed key. 

[0070] Similarly, when the numerical keys 1 1 N for "1 ", "2", "4" and "5" are manipulated, 
the tones having the frequencies LI , L2, Dl and D2 are generated. And since the 
tones having the frequencies LI , L2, Dl and D2 are also generated by depressing only 
the numerical keys 1 1 N for "1 " and "5" or for ,, 2 ,, and "4", further key manipulation can 
be skipped. 

[0071] This key manipulation skipping can be applied for numerical keys 1 IN that 

include a total of four keys in two columns and two rows, or a total of six keys in two 
columns and three rows, such as in the examples shown in Fig. 6 for the input of "se", 
"te", n hu(fu)", "he(fe)", "mi", "mu", "me" and "mo". 

[0072] In addition, if the controller 1 4 of the terminal 1 OA can cope with the 

simultaneous depression of several of the numerical keys 1 IN for "1", "2", "4", "5", "7" 
and "8", fast key input can be performed. 

[0073] An explanation will now be given, while referring to Fig. 9, for the character input 
process sequence performed by the terminal 1 OA that permits the entry of Braille in 
the above described manner. 

[0074] In the default state, the numerical keys 1 1 N of the terminal 1 OA are set in the 
numerical input mode for the entry of numbers. In this state, upon the receipt of a 
predetermined command, the mode is shifted to a character input mode. 

[0075] Further, when the terminal 1 OA is shifted to the character input mode, in 

accordance with the operation for inputting the first character it can automatically 
determine whether the input mode is the Braille mode, the portable telephone 
terminal mode or the pager mode. In this case, the portable telephone terminal 
character input mode, for example, is the default, and a priority order is established 
for the Braille and the pager character input modes. 
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[0076] When the numerical key 1 1 N for "7" is depressed and the pound sign key 1 1 S is 
depressed to confirm the entry, since in accordance with the portable telephone 
terminal mode this represents "ma", while in accordance with the Braille mode this 
represents "wa", a conflict occurs. If another character is input, however, no conflict 
occurs (although the manipulation for entering "a" is common both to the portable 
telephone terminal mode and the Braille mode). Therefore, so long as the keys 
depressed for the first character do not represent "ma" in the portable telephone 
terminal mode and "wa" in the Braille mode, the terminal 10A can automatically 
determine, from the first character, whether the character input mode is the portable 
telephone terminal mode or the Braille mode. When the keys depressed for the first 
character represent "ma" in the portable telephone terminal mode and "wa" in the 

a j 

I ^ Braille mode, in accordance with the manipulation of the numerical key 1 1 N, as 

f.^ feedback, the character converted using the default portable telephone terminal mode 

m 

fy is displayed on the display unit 1 2, or is output as speech from the loudspeaker 1 3. 

Then, if the user tries to input characters using Braille, a "delete" operation is 
performed for the first character and the initial process performed for the first 

l x character is repeated. Then, after this operation is detected by the key recognition 

v ™ 

£3 unit 1 5, the mode is automatically shifted to the Braille input mode. If, however, the 

y 

p user tries to input characters using the pager character input mode, the mode is 

|"f shifted to the Braille input mode and the same operation as that described above is 

performed. Thereafter, when this is detected by the key recognition unit 1 5, the mode 

is shifted to the pager character input mode. 

[0077] When the user issues a predetermined command to select, for the terminal 1 OA, 
the Braille character input mode, the portable telephone terminal character input 
mode, or the pager character input mode, the same character input mode is thereafter 
maintained so long as the user does not enter a mode change command. Further, 
once the Braille, the portable telephone terminal or the pager character input mode is 
selected, the selected character input mode data may be stored in the memory (not 
shown) of the terminal 1 OA, and the next time the character input mode is shifted, the 
previously selected character input mode may be automatically selected by referring 
to the stored character input mode data. 

[0078] p Qr character entry using the terminal 1 OA, first, the portable telephone terminal 
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character input mode, the pager character input mode or the Braille dot combination 
input mode is selected by employing the above described automatic identification 
process, or by a user. Then, when a command corresponding to the selected character 
input mode is generated, at step SI 01 the controller 1 4 of the terminal 1 OA identifies 
the type of command. Since the explanation for this embodiment will mainly cover 
Braille input, at step SI 01 a check is performed to determine whether the generated 
command is for shifting the input character mode to the Braille input mode. When it is 
ascertained that the generated command is a command for shifting the mode to the 
portable telephone terminal character input mode or to the pager character input 
mode, thereafter the character converter 1 6 shifts the mode to the portable telephone 
terminal character input mode in Fig. 1 4, or to the pager character input mode shown 
in Fig. 1 5. Since in the pager character input mode, all the characters are always 
defined as a two-digit matrix, all character entries can be sequentially accepted 
without requiring confirmation using the pound sign key 1 IS. 

[0079] But when at step SI 01 it is ascertained that the generated command is one for 

shifting the mode to the Braille input mode, the character converter 1 6 accepts Braille 
entries. 

[0080] When the user has selected the character input mode in the above described 
manner, and begins to enter a character string using Braille by manipulating the 
numerical keys 1 1 N for "1 "2", "4", "5", "7" and "8", the key recognition unit 1 5 
identifies the manipulated numerical keys 1 1 N and transmits the data therefore to the 
character converter 1 6 (step SI 02). 

[0081] 

The character converter 1 6 determines whether the pound sign key 1 1 S is 
depressed for confirmation for each character (step SI 03), and so long as the 
confirmation operation is not detected, the manipulations of the numerical keys 1 IN 
identified by the key recognition unit 1 5 are accumulated. Then, when the 
confirmation using the pound sign key 1 IS is detected, the accumulated numerical 
key 1 IN manipulations, i.e., the numerical string entered using the numerical keys 
UN, is employed to specify a Braille dot combination based on the correlations shown 
in Figs. 6, 7 and 8 (step SI 04). Subsequently, the character converter 16 converts the 
specified Braille dot combination into a corresponding character, and transmits 
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(outputs) the data for the character to the character string data storage unit 1 7 (step 
SI 05). 



they are received from the character converter 1 6 following the character conversion, 
and generates a character string (step SI 06). Each time a new character is added to 
the current character string, the character string data storage unit 1 7 transmits the 
data for the generated character string to the speech synthesis controller 1 8. The 
generated character string may also be displayed on the display unit 1 2 based on the 
data therefore. 

[0083] Based on the data for the generated character string, the speech synthesis 

controller 18 employs a speech synthesis program, stored in advance in the memory 
area of the controller 14, to perform a speech synthesis process, and generates 
speech synthesis data that it uses to output speech through the loudspeaker 1 3 (step 
SI 07). 

[0084] Then, a check is performed to determine whether the user has entered a 

predetermined end command using an input key 1 1 N (step SI 08). When no end 
command has been input, program control returns to step SI 02 to input the next 
character. When, however, an end command entry is detected, the Braille dot 
combination input process is terminated. 

[0085] The data for the input character string can be regarded as data for a character 
string input using the common portable telephone terminal input method. For 
example, the character data string can be transmitted (output) by the communication 
unit 19 to an external device for the exchange of messages. Further, as another 
example, when the terminal 1 OA includes an e-mail creation function, the data for the 
character string can be output to the e-mail document storage area, and stored 
therein a document to be used for e-mail. And when the terminal 1 OA includes an 
address book function, the data for the character string can be output to the address 
storage area of the memory, and be stored as address data. 



In this manner, when the user manipulates the input keys 1 1 N to enter dots PI to 
P6 for a Braille dot combination, the dot combination can be input to the terminal 



[0082] 



The character string data storage unit 1 7 stores the character data in the order 



[0086] 
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10A. At this time, since a string of input characters can be fed back as speech, even a 
visually impaired person can confirm input characters. With this terminal 10A, 
therefore, a visually impaired person will be able to enter character strings very easily. 

[0087] Since Braille is standardized for each language, and the required input 

manipulation does not differ depending on the maker of a terminal 1 0, it is a 
convenient tool for users. Because a total of only six numerical keys 1 1 N are 
employed when inputting Braille, and this system therefore requires a smaller number 
of keys than do the other systems (the portable telephone terminal system and the 
pager system), which employ all the numerical keys 1 IN, and because the distance a 
user's fingers must travel is smaller, erroneous operations seldom occur. 

[0088] While the above explanation has been given mainly by using the terminal 1 OA, the 
same configuration can be applied for the terminals 1 0B and 1 0C. 

[0089] In addition, when the input keys 1 1 are integrally formed, as for the terminals 10B 
and 1 0C, the numerical keys 1 1 N for "1 ", "3", "4", n 6\ "7" and "9" can be manipulated 
by both hands. Therefore, erroneous manipulation errors seldom occur, and 
characters can be input rapidly. Furthermore, since the terminal 10C can be folded so 
that both the display unit 1 2 and the input keys 1 1 are exposed, a user can hold the 
terminal 1 0C with the display unit 1 2 facing up, and can use the fingers of both hands 
to manipulate the input keys 1 1 on the reverse side. 

[0090] The thus arranged terminal 1 0 (1 OA, 1 0B or 1 0C) does not differ from a 
conventional telephone terminal in its hardware configuration, and can be 
implemented merely by changing the program stored in the controller 14. Further, 
while the terminal 10 includes the Braille input function, character input can also be 
performed using the portable telephone terminal method and the pager method, and 
since no special manipulative procedures are required for this, a person with normal 
sight will have no trouble using the terminal 1 0. 

[0091] 

In the first embodiment, the Braille dot combinations in Fig. 6 are employed as 
examples. For Braille, there are two sides: the side whereon Braille is read by touch 
(hereinafter referred to as the Braille reading side), and the side whereon Braille is 
written (hereinafter referred to as the Braille writing side). The example in Fig. 6, the 
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Braille dot combinations are viewed from the Braille reading side; however, for input, 
Braille is not limited to this, and may also be viewed from the writing side. Further, 
when entering Braille using the terminal IOC, since the input keys 1 1 are inverted 
relative to normal ones, inverted Braille may be input. It should be noted that it is 
preferable that a user of Braille select either normal input or inverted input. 

[0092] The terminal 10 in the first embodiment is so designed that in addition to the 
Braille input mode, the portable telephone terminal character input mode and the 
pager character input mode can be selected; in addition to the Braille input mode; 
however, the terminal 1 0 may include only one of these character input modes, or 
may include another input mode. 

[0093] A second embodiment will now be described. In the first embodiment, the 

terminal 10 comprises the character converter 1 6 for converting a Braille entry into a 
character, and the speech synthesis controller 18 for outputting speech synthesized in 
accordance with a character string that is input. In the second embodiment, a terminal 
50 that serves as a communication terminal does not have these components. In the 
following explanation, the same reference numerals are used to denote components 
corresponding with or identical to those in the first embodiment, and no further 
explanation for them will be given. 

[0094] Fig. 1 0 is a diagram showing a character input service system or a Braille service 
providing system according to the second embodiment. As is shown in Fig. 10, the 
terminal 50 of a user can access a server (a speech feedback server or a host server) 
70 at a service provider via a network, such as a public network 60. In this 
embodiment, the service provider provides, for example, a service for accepting a 
library book reservation from a user. 

[0095] In this system, when the user enters Braille using the terminal 50, a corresponding 
signal is transmitted to the server 70 via the public network 60. Based on the received 
signal, i.e., the Braille that is input, the server 70 identifies a corresponding character, 
and feeds back to the terminal 50, via the public network 60, speech data for orally 
reading this character. When the user enters Braille using the terminal 50 to transmit a 
character string to the server 70, the server 70 provides, for the user, a service that is 
consonant with the contents of the input character string. 
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[0096] As is shown in Fig. 1 1 , the terminal 50, which is a common terminal telephone, 

comprises at the least input keys 1 1 , a key recognition unit 1 5, a transmitter/receiver 
(signal transmission unit and reception unit) 51 , an input/output signal converter 
(signal generator) 52, and a loudspeaker 1 3. The transmitter/receiver 51 
communicates with external devices via the public network 60. And as a signal to be 
transmitted by the transmitter/receiver 51 , the input/output signal converter 52 
generates a signal (e.g., a tone signal, a pulse signal or a digital signal) that is 
consonant with the type of input key 1 1 identified by the key recognition unit 1 5. The 
input/output signal converter 52 converts a signal received by the 
transmitter/receiver 51 into speech that it outputs through the loudspeaker 1 3. 

[0097] In this embodiment, the terminal 50 can be a stationary telephone terminal, a 

portable telephone terminal or a wireless telephone terminal, and the terminals 1 OA, 
10B and 10C in the first embodiment can also be employed. Further, the terminal 50 
may also be an analog telephone terminal, i.e., any telephone terminal can be 
employed so long as it can transmit a signal in accordance with the contents input by 
the manipulated input key 1 1 , and output a speech through the loudspeaker 1 3 based 
on a received signal. 

[0098] As is shown in Fig. 1 2, the server 70 comprises a receiver 71 , for receiving a 
signal from an external device via the public network 60, a response controller 
(speech message output unit) 72, a key recognition unit 73, a character converter 
(Braille dot combination specification unit) 74, a character string data storage unit 
(character string generator) 75, a speech synthesizer (speech synthesis signal 
generator) 76, a transmitter 77 for transmitting a signal to an external device via the 
public network 60, and a processor (process execution unit) 78. 

[0099] When a connection to the terminal 50 is established, the response controller 72 
outputs a speech signal for a predetermined response message based on a response 
scenario program stored in a response scenario storage unit 72a. The speech signal is 
transmitted by the transmitter 77 to the terminal 50. 

The key recognition unit 73 functions in the same way as the key recognition unit 
1 5 in the first embodiment. That is, the key recognition unit 73 identifies the type of 
input key 1 1 that is manipulated based on a signal received from the terminal 50 via 
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the public network 60, and transmits the results to the character converter 74. As well 
as the character converter 16 in the first embodiment, the character converter 74 
performs character conversion based on the contents of the manipulated input key 
1 1 . That is, the character converter 74 accepts a Braille entry using the numerical key 
1 1 N, converts the Braille entry into a corresponding character, and transmits (outputs) 
the data for the character to the character string data storage unit 75. Since the same 
Braille conversion rule as in the first embodiment is employed by the character 
converter 74, no further explanation for it will be given. When the terminal 50 
employs DTMF, it is especially effective for the character converter 74 to use the 
conversion rule for skipping input explained in the first embodiment. 

[01 01 ] As well as in the character string data storage unit 1 7 in the first embodiment, the 
character string data storage unit 75 stores character data are in the order in which 
they are transmitted by the character converter 74, generates a character string, and 
transmit the data for the string to the speech synthesizer 76. Based on a speech 
synthesis program stored in advance, the speech synthesizer 76 performs a speech 
synthesis process for the received character string data and generates a speech signal 
as a feedback signal. The obtained speech signal is then transmitted by the 
transmitter 77 to the terminal 50. The processor 78 identifies the contents requested 
by a user in a message consisting of a character string, and performs a corresponding 
process. 

[01 02] The processing performed by the thus arranged system will now be described 
while referring to Fig. 1 3. 

[01 03] As is shown in Fig. 1 3, when a user employs the terminal 50 to make a call to the 
server 70, the server 70 accepts the call and logs it in (step S201). Based on the 
response scenario program stored in the response scenario storage unit 72a, the 
response controller 72 of the server 70 automatically outputs a speech signal as a 
response message requesting that the user enter a character string (step S202). 
Specifically, the entry of the title or the author of a book the user wants to make a 
reserve is requested. 

The speech signal is transmitted by the transmitter 77 to the terminal 50. At the 
terminal 50, the transmitter/receiver 51 receives the speech signal, and the 
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input/output signal converter 52 converts the speech signal into speech and outputs, 
through the loudspeaker 1 3, the speech as a response message from the server 70. 

[01 05] The user enters, at the terminal 50, an answer message or a request message 

corresponding to the contents of the response message, i.e., the information for the 
title or the author of a book the user desires to reserve. At this time, as in the first 
embodiment, the user manipulates the numerical keys 1 IN (see Fig. 5) of the input 
keys 1 1 to enter Braille dot combinations that represent the character string of the 
message, and confirms each character by depressing the pound sign key 1 IS. Each 
time the user manipulates the numerical keys 1 1 N or the pound sign key 1 1 S of the 
terminal 50, a signal is transmitted to the server 70. Specifically, a signal (a tone 
signal, a pulse signal or a digital signal) that is consonant with the numerical keys 1 1 N 
or the pound sign key 1 IS identified by the key recognition unit 1 5 is generated by 
the input/output signal converter 52 and is transmitted by the transmitter/receiver 51 
to the server 70. This is no different from what happens when a signal is transmitted 
as a key for a conventional telephone terminal is manipulated. 

[01 06] When the server 70 receives a signal from the terminal 50 each time a numerical 
key 1 1 N or the pound sign key 1 IS is manipulated (step S203), the key recognition 
unit 73 identifies the type of numerical key 1 1 N that was manipulated or the pound 
sign key 1 1 S, and transmits the data to the character converter 74 (step S204). 

[01 07] The character converter 74 determines whether the confirmation for each 

character using the pound sign key 1 IS has been performed. So long as the character 
converter 74 does not detect a confirmation operation, the manipulation contents of 
the numerical keys 1 1 N identified by the key recognition unit 73, i.e., the data for a 
numerical string entered by using the numerical keys 1 1 N, are accumulated. Then, 
when a confirmation operation using the pound sign key 1 IS is detected, a check is 
performed to determine whether the content (the numerical strings) of the numerical 
keys 1 IN that have been manipulated is a predetermined message input end 
command (step S205). 

When the data do not constitute a message input end command, the input Braille 
dot combination is specified by referring to the correlations in Figs. 6, 7 and 8, and in 
accordance with the manipulations (the numerical string) of the numerical keys 1 IN. 
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Then, the character converter 74 converts the specified Braille dot combination into a 
corresponding character, and transmits (outputs) the data for the character to the 
character string data storage unit 75 (step S207). 



sequentially in the order in which they are received from the character converter 74, 
and a character string and the data therefore are generated. Each time a new character 
is added to the generated character string, the data for the generated character string 
is transmitted by the character string data storage unit 75 to the speech synthesizer 
76 (step S208). 

[01 1 0] The speech synthesizer 76 performs a speech synthesis process for the data for 
the received character string, and generates speech synthesis data (speech response 
signal), while the transmitter 77 transmits to the terminal 50 a speech signal 
corresponding to the speech synthesis data (step S209). 

[01 1 1] In the terminal 50 the input/output signal converter 52 converts the speech signal 
received from the server 70 into speech, and the speech is output through the 
loudspeaker 1 3. This speech is a character string that the user entered at the terminal 
50 using Braille, and the user receives the speech that serves as feedback for the 
message that he or she entered. Until the entry of the message is completed, the user 
continues to input Braille dot combinations to the terminal 50, and the processes at 
steps S203 to S209 are repeated. 

[01 1 2] When the entry of the message is completed, the user enters the predetermined 
end command using the input keys 1 1 , and finally confirms it using the pound sign 
key 1 IS. Then, as during normal Braille input, the server 70 receives a signal 
corresponding to the operation (step S203), identifies the key type (step S204), and 
ascertains that the end command has been input at the terminal 50 (step S205). In 
this case, the processor 78 accepts the character string that was received at the 
terminal 50 before the end command was entered, i.e., the message received from the 
user. Further, the processor 78 identifies the contents of a user's request in the 
received message, and performs a corresponding process based on a predetermined 
process program (step S21 0). For example, based on the title or the author of a book 
the user reserves, the processor 78 performs a process a search of the books in stock. 



[0109] 



In the character string data storage unit 75, the character data are stored 
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[01 1 3] When the process at S210 has been completed, in order to perform all the service 
related processes provided by the service provider, a check is performed to determine 
whether, based on the response scenario program stored in the response scenario 
storage unit 72a, all the processes have been completed (step S21 1). When not all 
processes have been completed, the program returns to step S202 and the automatic 
response message to advance to the next process is output. For example, the 
presence/absence in stock of the book is a response given as a result of the search, 
and when the book is in stock, an inquiry is transmitted to determine whether the 
user desires to reserve the book. In this manner, until information required to 
complete all the service related processes provided by the service provider is 
obtained, the server sequentially transmits an automatic response message to the 
terminal 50, and the user inputs a corresponding message. That is, when the book 
desired by the user is in stock, and when the user desires to reserve the book, the 
user is requested to enter information, such as his or her registration number and 
name, and to perform a process required to complete the reservation or to accept a 
search for another book. Further, the book is not in stock, a process required for 
completing a series of procedures is performed. 

[01 14] When it is ascertained at step S21 1 that all the service related processes have 
been completed, the server 70 performs a process for logging out the terminal 50 
(step S212). 

[01 1 5] With the above system configuration, the user can employ the terminal 50 to enter 
Braille dot combinations in the same manner as in the first embodiment. Since the 
input character string is fed back by the server 70 and is output as speech, even a 
visually impaired person can confirm an input character string. Therefore, a visually 
impaired person can easily input character strings using this terminal 50. Further, as 
the function for identifying the Braille dot combinations and the speech synthesis 
function are not required for the terminal 50, a conventional terminal 50 can be 
employed unchanged. Therefore, a user does not need purchase a new terminal, and 
can also use a public telephone when he or she is away from the office. 

Further, according to the system, when the user employs the terminal 50 to enter, 
using Braille, information for a desired book in accordance with a speech response 
09682896 Page 24 



[0116] 



APP ID= 



message transmitted by the server 70, the user can receive the service, such as 
reservation of a book. Thus, a visually impaired person can also receive various 
services using the terminal 50. 

[01 1 7] In this embodiment, the service provider uses the server 70 to provide a book 

reservation service for a library, the services that can be offered are not limited to this 
one. For example, so that various services can be provided for a user, on a portable 
telephone terminal a service provider conventionally uses a character string to display 
a menu screen for the user and the user must then perform a predetermined 
operation on the menu screen; however, a variety of services may also be provided 
when speech is used to inform a user of the services that are available from a service 
provider, and the user employs Braille to enter a reply or a response. 

[01 1 8] In the above embodiment, Braille is entered at the terminal 50. However, as well as 
the character converter 1 6 of the terminal 1 0 in the first embodiment, the character 
converter 74 of the server 70 can accept characters entered using the portable 
telephone terminal input mode or the pager input mode, so that characters can be 
input at the terminal 50 using either of these two modes. 

[01 1 9] In the first and second embodiments, a so-called telephone terminal is employed 
as the terminals 10 and 50. However, so long as multiple keys that can be used to 
enter Braille and a speech output unit for outputting speech as feedback are included, 
a portable information terminal, such as a PDA (Personal Digital Assistants), may be 
employed. 

[01 20] Further, the configuration of each embodiment can be selectively employed or can 
be variously modified without departing from the scope of the invention. 

[0121] As is described above, according to the invention, since Braille input is enabled, an 
input apparatus, a communication terminal and a portable communication terminal 
can be provided that are eminently superior in usability for visually impaired persons. 
Further, according to the speech feedback system of the invention, convenient 
services can be provided for visually impaired persons. 
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